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INTRODUCTIOH 

This investigation involves two types of technology 
which are presently being experimented with in an effort 
to improve teacher education. One of these involves the 
use of films and audio and visual tape recorders to enable 
novice teachers to examine their teaching behavior and to 
obtain feedback about their efforts to improve their per- 
formance.- Several new products have increased the use of 
whis type of technology. The light, transistorized, port- 
able audio tape recorder enables the teacher to have a 
recorder with him virtually wherever he goes to teach. 
Television tape recorders encourage the development of 
settings where teachers can get immediate visual and audi- 
tory feedback. The development of inexpensive sound mo- 
tion picture cameras has resulted in highly portable 
audio-visual feedback equipment. Last, the availability 
of very high speed film has made it possible to take stiU 
and motion pictures in classrooms without the disruption 
caused by the intrusion of intensive light sources. 

The second technology has come about through the de- 
velopment of systems for the intellectual analysis of 

that can be taught to novice teachers 



teaching — systems 
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to enable them to analyze their teaching behavior and to 
set goals for the improvement of their performance. As 
will be seen presently, several of these analytic systems 
have been constructed specifically for use in teacher edu- 
cation programs. 

The simultaneous application of both technologies — 
the new devices for recording behavior for feedback and 
the schemes for the systematic analysis of teaching — is 
now being experimented with in teacher education settings. 
In several centers research is now being undertaken to de- 
termine the effectiveness of these technologies for the 
improvement of teacher training. It appears very likely 
that teacher education programs of the future will include 
components that involve these two technologies, combined 

to permit the novice teacher to analyze his behavior, set 

^ ■ 

goals for the Improvement of his performance, and to ob- 
tain feedback on his progress toward his new goals. These 
components can be referred to as integrated feedback sys- 
tems. 

As integrated feedback systems come into being, they 
will be accompanied by changes in the roles to be played 
by instructional personnel the teacher education pro- 
The nature of these roles is yet to be determined. 
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The roles that will emerge will depend partly on the capa- 
bility of the persons involved in teacher training, partly 
on the types of training that they are given and partly on 
the requirements of the feedback components that are devel- 
oped. 

It is on this problem of staff utilization in teacher 
education that the present investigation id f ocussed. — ^ 
seeks to examine how college instructors , cooperating 
x^eacherSt and student teachers behave whe n integrated feed- 
back systems are introduced into the teache r education pro- 
g;ram . The results of the investigation will be interpreted 
in teims of recommendations for the developing roles of 
teacher education personnel and guidelines for the retrain- 
ing of teacher education personnel when integrated feedback 
systems are constructed. 

Background of the Problem 

The problem has its origin in the attempts to develop 
for teacher education new components that combine the po- 
tential in film, audio, and television tape feedback with 
strategies for analyzing teacher behavior systematically. 
For example, Allen and MacDonald ( 7 ) have developed and 
studied a process named ”Micro -teaching”. In this process 
the novice teacher teaches small groups of children while 
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concentrating on the perfection of one teaching maneuver 
at a time. Immediately after teaching, he receives a 
television feedback and coaching. In successive practice 
sessions, he polishes his new teaching maneuver. 

Gold, Schueler, and their associates ( 8 ) have com- 
bined television tape feedback with the use of the analy- 
tic system developed by Medley and Mitzel ( 6 ) . 

Joyce and Hodges have developed a system of feedback 
and analysis called Instructional Flexibility Training 
(5 ). In their system, student teachers are taught an 
analytical scheme, the Conceptual Systems scheme, and 
taught to apply it to the analysis of their teaching. The 
goal is to induce the novice teacher to expand his reper- 
toire of available teaching maneuvers, as outlined in Joyce 
and Harootunian ( if ) and to assist their fellow student 
teachers to expand their arsenals of teaching maneuvers. 

Probably the most extensive work has been done by 
Flanders, Amidon, and their associates (i ) who have devel- 
oped an analytic system called ^interaction analysis” 
which is taught to the teacher so that he can provide him- 

I 

self with feedback about his teaching performance. In 
several investigations, evidence has been accumulated that 
indicates that novice teachers who employ interaction 
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analysis tend to become more indirect and flexible in 
their teaching methods than studen*‘. teachers who are not 

exposed to the method# 

Work has progressed to the point where it is desirable 
to examine how teacher education personnel should be de- 
ployed in integrated feedback systems. Specifically, it 
is important to learn how college teacher education per- 
sonnel behave when integrated feedback systems are intro- 
duced into the teacher education program. Do they find the 
feedback systems useful for some purposes and not for 
others? Do feedback systems duplicate or replace other 
supervisory systems? What kinds of difficulties are en- 
countered in implementing feedback components? What new 
roles do they generate that require training for super- 
visory personnel? 

Also, since both the media feedback and the analytic 
systems provide student teachers with the equipment for 
tracking and assessing their own behavior, new roles for 
students are likely to be possible in the teacher educa- 
tion program. It is desirable to begin to explore what 

these new roles might be. 

Ultimately it should be possible, after adequate 
staff utilization studies, to design integrated feedback 
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systems that utilize media, analytic systems, and per- 
sonnel, Including student personnel, in a coordinated 
fashion. 

The research herein described has been designed to 
begin to explore the deployment of personnel when inte- 
grated feedback systems are used in teacher education. 

During the Fall of 1966, an integrated feedback sys- 
tem was introduced into the pre-service teacher education 
program at Teachers College, Columbia University. It was 
included in the curriculum for thirty students who were 
preparing to be elementary school teachers. These thirty 
s^':dents were supervised, in their student teaching, by 
three supervisors, each of whom was assigned to ten stu- 
dents. The supervisors were themselves doctoral students 
in curriculum and teaching at Teachers fjollege. 

Student teaching, in the pre-service program at 
Teachers College, occurred during 1966-67 in two segments. 
The first segment consisted of experience in public school 
classrooms about two days each week for the Fall semester. 
The second segment consisted of four days each week for 
Lojut twelve weeks of the Spring Semester. During the first 
semester, each student was assigned to several cooperating 
teachers for about four weeks each, in order to give him 
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contact with several age groups and subject areas. Dur- 
ing the second semester the students were assigned to one 
or two cooperating teachers unless there were special cir- 
cumstances that resulted in his being shifted more often 
during the semester. 

.ormally, each student was visited once each week 
by his supervisor. In addition, each student was sche- 
duled for a private conference once each week (with the 
supervisor). Also, each of the groups of ten student 
teachers met once each week with the supervisor in a 

seminar. 

Into this setting, which had been a well established 
routine for several years, was introduced the means for 
carrying on an integrated feedback system. Enough light, 
portable audio tape recorders were procured so that each 
pair of student teachers had one available for their use. 

A large supply of audio tape was procured and made avail- 
able to them. Each student teacher was required to make a 
weekly tape of his teaching, so that tapes were always 
available for analysis if students or supervisors desired 

to make use of them. 

A cameraman was also employed to make motion pictures 
and time-lapse thirty-five millimeter strip films of teaching 



This canisrainan worked regular hours each week, and it was 
possible for student teachers to schedule him to film 
their teaching, or for a supervisor to schedule him to film 
a student whose teaching they wished to analyze. 

A television tape recorder and operator were made 
available to the program for several days and children 
■j^ere available to sei*ve as pupils within the television 
setting. Each student in the program was televised twice, 
despite the time limitations on the use of these media. 
There were few limitations, however, on the number of 
times a student could be taped or filmed either with a 
motion picture or time-lapse still camera. 

Each supervisor was provided with an audio tape re- 
corder and was able to schedule eight millimeter sound 
projectors and thirty-five millimeter strip film projectors 
as he needed them. In addition, the supervisors were able 
to schedule the television tape devices for their seminars 

when they needed that equipment. 

None of the supervisors had been previously trained 
to use any of the systems for analyzing teaching behavior. 
(See Bellack, ( 2 ) or Medley and Mitzel, ( 6 ) for an over- 
view of many of the systems that are in use today.) A 
special seminar was instituted under the direction of the 
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principal investigator. The purpose of this seminar was 
to provide help to the supervisors — help in the use of 
feedback systems with student teachers. The principal in- 
vestigator, after outlining the feedback system, tried to 
limit help given to the supervisors so that thcjy received 

aid only when they asked for it. 

By limiting training it was hoped that the roles the 
supervisors would play in the feedback system would be 
ones they would ”ns,turally^ develop. If the feedback sys- 
tem were tightly spelled out and if rigorous training had 
been given to the supervisors, then it would not have been 
as possible to observe naturalistic staff utilization 
patterns. Therefore, the feedback system was described to 

the supervisors as follows: 

1. All students were to learn a system for the be- 
havioral analysis of teaching. 

2. All students were to make a weekly tape recording 
of a lesson they taught, were expected to analyze the 
lesson and to be prepared to use it in conferences and 

seminars with their supervisors. 

3. Students, in consultation with supervisors were 
to schedule filming and video-taping of their teaching. 

4. Supervisors and students were to have weekly 
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conferences in which supervisors were to assist students 
to analyze their teaching, set goals for improving their 
teaching, and learn to Judge their progress, using the be- 
havioral analysis technique. 

5. In weekly seminars, supervisors would help groups 

of students analyze teaching and set group and individual 
goals for the expansion of their repertoire of teaching 
maneuvers and to develop strategies for coping with com- 

mon probieraa in wSwCliinfte 

Initiating the Program 

The supei*visor5 and the student teachers were given 
copies of the Manual for Coding the Verbal Behavior of 
Teachers which is Appendix B of Joyce and Harootunian 
( 4 ) . The principal investigator conducted several 
sessions in which studonts and supervisors were together 
instructed in the use of the manual to analy2je teaching 
and set goals for the improvement of teaching performance. 
Tapes and films were used in these sessions. 

Following these initial sessions, the student teach- 
ing program proceeded with its normal schedule, except 
that in conferences and seminars films, tapes, and the 
analysis of teaching were to be used as the strategy of 

supervision. 
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Several cooperating teachers were identified and 

i ■ 

Joined to the seniinars of each supervisor* During the 
second semester these cooperating teachers from the New 
York City public schools took over the leadership of 
several of the seminar sessions in order to provide an 
opportunity to study their behavior in the roles of 
seminar leader# Several of the seminars in the first 
semester were led by students in order to provide the 
opportunity of studying their behavior in the leader- 
ship roles. 

(Questions to Answer 

The central question that guided the design of the 
study was ''When television tape, filming, and the analysis 
of teaching are introduced into the student teaching pro- 
gram, (in an integrated feedback system) what changes 

I 

should be made in the utilization of supervisors of 
student teaching?" 

The strategy of the study was developed around four 
specific questions: 

1, The first question deals with the amount of in- 

i ^ 

. struct ion in feedback techniques that is needed before 
the system begins to function for the student teacher* 

The question was phrased: 
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"How much large group Instruction in the analysis 
of teaching is required before trainees employ the 
system of analysis in the analysis c r tu.sir own teach- 
ing?" 

The general method employed to answer this question 
was to analyze the content of conferences between stu- 
dents and supervisors to determine the stages at which 
the systems began to be used tmd the kinds of use to 

which they were put. 

2. The second question deals with the ability of 

student teachers to fulfill feedback roles. 

"Can teacher trainees, independent of faculty, 
carry on the feedback and analysis session?" 

This question was explored by instituting student 
leadership for seminars and comparing the content of those 

seminars with faculty-led seminars. 

3 . The third question deals with the ability of co- 
operating teachers to assume important roles in the feed- 

back process. 

"To what extent can cooperating teachers from the 
public, schools substitute for college faculty in providing 

feedback to student teachers?” 

The general method for exploring this question was to 
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involve several cooperating teachers from the public 
schools in the seminars, where they substituted for 
college faculty several times# The content of the co- 
operating teacher-led seminars was compared with the 
content of the faculty-led seminars. 

4 . The fourth question deals with the amount of on 
the spot supervision of student teachers which is needed 
in addition to the supervision provided through the feed- 
back system. 

^^How much ^live^ classroom visitation of student 
teachers is required in addition to the analysis and feed- 
back sessions (conferences and seminars) around which su- 
pervision was organized?^ 

The general method for this question was to vary 
amounts of live supervision and examine the effects on the 
content of conferences, on the student-initiated demand 
for supervision, and on student and faculty judgment about 
the adequacy of supervision for each student. The chart 
which follows, ^Strategy of Staff -Utilization Study,” 
summarizes the questions, general methods, and potential 
yield of the study# 
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Method 

The general method was to institute filming and taping 
of student teachers, to teach supervisors and student teach- 
ers to use a category system for analyzing teaching behavior, 
and to observe the behavior of the supervisors and student 
teachers in the conferences and seminars that were to serve 
for feedback sessions (sessions in which the student teach- 
ers would analyze their teaching, set goals for improvement, 
and learn to give themselves feedback on their progress.) 

The focus of the investigation was the feedback 
sessions — both the conferences that supervisors had on a 
weekly basis with each student teacher, and the seminars 
that each supervisor held on a weekly basis with his group 
of ten student teachers. 

The methods of the study varied somewhat in order to 
obtain data pertinent to each of the four questions that 
guided the investigation. 

Method for the First Question . 

”Kow much instruction in the analysis of teaching is 
required before trainees employ the systems of analysis 
in the analysis of their own teaching?” 

In the beginning of the Fall Semester, at the begin- 
ning of the teacher education program but before student 



Page 17 



teaching had begun, the principal investigator held four 
two-hour lecture-demonstrations in which he taught trainees 
and supervisors how to employ the 'Manual for Coding the 
Verbal Behavior of Teachers" and how to employ tapes, films, 
and the behavioral analysis so as to set goals and monitor 
progress. (See Joyce and Hodges ( 5 ) for a complete over- 
view of the procedures.) Then, as the student teaching 
period began, in the middle of October, tape recorders and 
tapes were issued to the student teachers, who were in--* 
structed to bring a tape recording of one of their lessons 
to their weekly conference with their supervisor, so that 
it would be available for feedback use. In addition, a 
cameraman, with equipment for sound motion pictures and 
thirty-five millimeter time-lapse photography, was put on 
a schedule that made him available to the student teachers 
provided that they scheduled themselves for his services. 

The super\'isors agreed to build their seminars and 
conferences around the tapes and films-to continue to teach 
the student teachers how to use the "Manual" to analyze 

their teaching. 

After each conference, each supervisor and each stu- 
dent filled out a questionnaire that was constructed to 



Page 

obtain their opinion about the questions and issues that 
were discussed and the extent to which the tapes, films, 
and ^Manual’’ were utilized in the conference. 

The questipnaires were entitled the ”Log of Super- 
■visory Conferences — Supervisors" apd the "^.pg of Super- 
■ visory Conferences -- Student Teachers,** respectively. In 
addition ‘to these two forms, the' supervisbr completed, 
after each conference, a special questionnaire entitled 

i' 

the' **Language of Analysis in Conferences** which was con- 
structed to obtain more specific information about the stu- 
dent’s comfort and skill in using the language of the 
**Manual** in the conference sessions. 

These questionnaires permitted a description to be 
made of the issues and problems that made up the content of 
the conferences throughout the year from the point of view 

I 

Of the supervisors and the student teachers. They also per- 
mitted a comparison of the judgments of the supervisors and 
the students regarding the use of the feedback system to 
which they were being exposed, as well as the supervisors*. 
Judgment about the competence of the student to use the 

i 

system to set goals and monitor his progress. 

Method Used for Question Two . 

**Can teacher trainees, independent of faculty, carry 

! 

o 

ERIC 



I 
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on the feedback and analysis sessions?” 

In order to test this' hypothesis, the supervisors 
were insti^cted to arrange to absent themselves for not 
less than four seminars during the first semester, turn- 
ing the leadership of the seminar over to the students. 

All of the seminars were tape-recorded, both those 
lead by the supervisors and those lead by the student 
teachers. These tape recordings were then submitted to a 
content analysis of the verbal interaction of the seminars 

in order to determine the use of the feedback system to 

\ 

approach the content of the seminars. In this way it was 
possible to compare the content and use of the feedback 
system in supervisor and student-led seminars. 

In addition to this, all students completed a ques- 
tionnaire, (the ’’Questionnaire on Seminars”) at the end of 
the semester. This questionnaire was designed to obtain 
the opinion of the students about the differences between 
the seminars that they conducted and those that were con- 
ducted by the faculty supervisors. 

Method of the Third Question,., 

The third question was investigated during the second 

or Spring semester: 

”To what extent can cooperating teachers from the 
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public schools substitute for faculty in providing feedback 
to student teachers?” 

The methods used to obtain data relevant to this ques- 
tion were essentially the same as those used with respect 
to the second question, except that cooperating teachers 
were the focus. Cooperating teachers from the schools in 
which the student teachers carried out their student teach- 
ing were identified and agreed to participate in the 
seminars in which feedback was given. After several 
seminars, the cooperating teachers began to give leader- 
ship to sessions from which the supervisors absented them- 
selves. Again, all of the seminars were tape-recorded and 
once again they were submitted to a content analysis. This 
analysis enabled a determination to be made of any similari- 
ties and differences, bt'tween the content and use of the 
feedback system when supervisors or cooperating teachers 
were the leaders. 

Also, at the end of the semester, a questionnaire was 
administered to the student teachers asking them to give 
their opinion about the diffei'ences between the seminars 
that were led by cooperating teachers and those that were 

t 

t , 

led by the faculty supervisors. 



i 
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The Method of the Fourth Question;, 

”How much "live* classroom visitation of student 
teachers is required in addition to the analysis and feed- 
back sessions around which the Supervision was organized?" 

Because the feedback system theoretically provides the 
student teachers with a method which they can use to assess 
and improve their own teaching, and because it makes it 
possible for supervisors and student teachers to analyze 
tape recorded and filmed samples of teaching, it is possible 
that it may reduce 'the amount of time that supervisors need 
to spend in the classroom with the student teaching. In the 

eventual construction of feedback systems that utilize per- 

it . . 

sonnell optimally, ftshOuld be possible to have cooperating 

teachers to perform certain functions, student teachers 

themselves can perform others, and the supervisors role may 

change substantially from what it has been. 

The present investigation approached this question 
bather tentatively and indirectly by reducing the amount of 
"live" classroom visitation that half of the students re- 
ceived and observing the effects of the reduction in direct 
supervision on the remainder of the supervisory process. 

Half of the students were visited by their super- 
visors in their classrooms once each week, which is the 
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nonnsil supsrvision provided in lihe Teachers College j 
Columbia, student teaching program. The remainder of the 
students were visited half as often# To control for dif- 
ferences in the personal style of the supervisors, each 
supervisor visited half of his teachers each week and half 
of them every other week. 

An analysis of the Logs of Supervisor Sessions was 
performed to determine whether the content of conferences 
varied with the amount of live supervision received. 

The end of semester questionnaires were similarly 
analyzed to see if differences existed between the group 
receiving the varying amounts of supervision. 

In addition, the students in each group filled out 
what were called ^Monthly Questionnaires to Determine 
Supervisory Adequacy” in which they rendered their opinions 
about the substance of the supervision they were receiving. 

To provide an objective measure of whether the stu- 
dents felt that their supervisors were providing them with 
sufficient help, the supervisors were provided with a form 
called an ”0n»Call” Report. They were instructed to com- 
plete one of these forms whenever a student requested an 
unscheduled discussion of teaching with them. The ”on 
call” report asked for a description of the content of the 



Form C-2 
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MONTHLY QUESTIONNAIRE FOR SUPERVISORY ADEQUACY 

Name of Supervisor ^ . D ate 

Name of Student : — . 

A. How many times have you been visited this past 

month? ■ 

B. In what ways has your student teaching experience made 
you a stronger person or teacher? Explain where 
necessary. 



1. 


General growth and maturity ■ 


0 1 2 3 4 5 


2. 


Better rapport with the children 


0 1 2 3 4 5 


3. 


Better rapport with your cooperating 






teacher 


012345 


4. 


• * 

More varied approaches to teaching 


0 1 2 3 4 5 


5. 


Greater ease and confidence in the 






classroom 


0 1 2 3 4 5 


6. 


Greater sense of purpose 


012345 


In 


what areas have you had the most 




difficulty? 


012345 


7. 


Rapport with your cooperating teacher 


012345 




Rapport with children or discipline 


012345 


9. 


Classroom procedures and organization 


0 1 2 3 4 5 


10. 


Teaching techniques 


012345 


11. 


Your own personal or emotional problems 


012345 



0. Do you feel you have had adet^uate supervision this month? 
Too much? Too little? Explain if necessary. 

E. Have the seminars helped your student teaching experience 
Explain . 

F. Has taping and filming helped or hindered your teaching 
experience? Explain. 



Form C-1 

Supervisor's Form 
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MONTHLY QUESTIONNAIRE FOR SUPERVISORY ADEQUACY 



Name of Supervisor 



Date 



Name of Students 



A. How many times have you visited these students 

this past month? 

B. In what ways has her student teaching experience made her 
a stronger person or teacher? Explain where necessary. 



1 . General growth and maturity 

2. Better rapport with the children 

3 . Better rapport with her cooperating 
teacher 

4. More varied approaches to teaching 

5 . Greater ease and confidence in the 
classroom 

6 . Greater sense of purpose 
C. In what areas has she had the most difficulty? 

7 . Rapport with her cooperating teacher 

8 . Rapport with children or discipline 

9 . Classroom procedures and organization 
10 .■ Teaching techniques 



012345 



012345 



012345 

012345 



012345 

012345 



012345 

012345 

012345 

012345 



11. Her own personal or emotional problems 012345 

D. Do you feel that this student has had adequate supervision 
this month? Too much? Too little? Explain if necessary. 



Form A 
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»»0N-CALL” REPORTS BY COLLEGE SUPERVISORS 



Name of Supervisor^ 
Name of Student 



Date 



Approximate length of time of session_, 

A. Checklist of topics covered during the session, 
where emphasis was heavy and where light.) 



(Note 



1. 


Classroom procedures 


0 12 3 4 


2. 


Discipline 


0 12 3 4 


3. 


Teaching techniques 


0 12 3 4 


4. 


New activities proposed and/or planned 


0 12 3 4 


5. 


Existing activities developed or 






modified 


0 12 3 4 


6. 


Specific children— progress and/or 






problems 


0 12 3 4 


7. 


Community affairs as they affect the 






school 


0 12 3 4 


a. 


The Student’s effectiveness in the 






classroom 


0 12 3 4 


9. 


Ways of making her graduate work more 


• 




meaningful in the classroom situation 


0 12 3 4 


10. 


Personal or emotional problems 


0 12 3 4 



B. Was the initiative during the session taken by the 
supervisor, the student, or both of you? 



ERIC 




X 
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discussion and a judgment about whether the students were 
having special problems of any kind. It was thought that 
students who were not receiving sufficient help with their 
problems might request, more extra conferences than those who 

I 

felt that their progress was satisfactory. Tabulation of 
the ”on call” reports would make it possible to detemine 
whether students receiving less classroom supervision re- 
acted by asking for more contact with their supervisors. 

In addition to the above, some informal observations 
were made by the principal investigator and the research 
staff because of their close proximity to the feedback pro- 
cess. From time to time as the results are presented, 
these informal observations will be made. For, although 
they belong in the category of ”soft” data, they yielded 
information about several important aspects of staff util- 
ization which were not included in the formal research 
design. 



I 
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Results 

The results of *the investigation will be presented in 
four sections. Each section will present the results as 
they pertain to one of the four questions around which the 
investigation was organized. 

■The First Questions 
”How much large group instruction in 
feedback and analysis is required 
before the teacher trainees employ 
the feedback system in the analysis 
of their own teaching?” 

The investigation was designed to yield evidence con- 
cerning two interrelated aspects of student use of the 
analytic techniques; their actual use of the system and 
their comfort with its use. Questionnaires were, as de- 
scribed earlier, administered after each conference and 
monthly to solicit the opinions of both the students and 
their supervisors about the content of the conferences and 
their use of and comfort with the feedback system. These 
questionnaires were tabulated monthly, which permitted a 
running account of those opinions, so we are able to make 
some judgment about the point during the year when the stu- 
dents and their supervisors began to use the system 



Page 



extensively and comfortably. 

After the initial presentation of the feedback system 
by the principal investigator, each supervisor devoted at 
least a part of each of the weekly seminars to the use of 
the feedback system. (In weekly sessions with the super~ 
visors , the principal investigator carried on a parallel 
program of the instruction for the benefit of their com- 
petence, as described above.) The task of this section of 
the report is to examine the data which were collected to 
see at what point in this course of instruction the stu- 
dents began to use the system comfortably and effectively. 

Content of Supervisory Conferences 

The ”Log of Supervisory Conferences: Student Teachers” 

and the ”Log of Supervisory Conferences: Supervisors” were 

used to maintain a running account of the content of the 
seminars. The two questionnaires ir eluded nine common 
items which were answered on a scale and could be tabulated 
objectively. The questionnairs are presented on pages 2$ 

and 3Q. 

Table One contains the means and standard deviations 
for the student teacher form of the Log of Supervisory 

I 

Conferences for six months of the study. These were the 
six months when the students were actually in the classroom 
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LOR OF SUPy.RVISORY CONFERSNCE — Studeat Teachers 



Name of Student. 



Date_ 



Name of Supervisor 



A\ proximate length of time of session^ 



A. Checklist of topics covered during the session (Note where 
emphasis was heavy and where light) 



le Classroom procedures 

2. Discipline 

3 . Teaching techniques 

4. New activities proposed and/or planned 



‘5 



Existing activities developed or 
modified 



0 1 2 3 4 5 
0 1 2 3 4 5 
0 1 2 3 4 5 
0 1 2 3 4 5 

0 1 2 3 4 5 

0 1 2 3 4 5 

0 1 2 3 4 5 
0 1 2 3 4 5 

0 1 2 3 4 5 
0 1 2 3 4 5 



6. Specific children— progress and/or 
problems 

7, Community affairs as they affect the 
school 

Your effectiveness in the classroom 

9. Ways of making your graduate work more 
meaningful in the classroom situation 

10. Personal or emotional problems 

B. Seminars 

Have the seminars been related to your student 
teaching? 

Can you give an example of how they are related? 

Or a reason why they are not? 

C. Filming and Taping 

1, Has the practice of filming and taping lessons been 
related to the teaching experience you have been 
having? If so, how? If not, why not? 



Form B-if 
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T.QG OF SUPE RVISORY CONFERENCES Supervisors 

Name of Student____ 

Name of Supervisor — 



Approximate length of time of session 

A Checklist of topics covered during the session (Note 
where emphasis was heavy and where light) 



1 . 

2, 

3. 

4. 

5. 

6 . 

7. 

8. 

9. 

10 . 



Classroom procedures 
Discipline 
Teaching techniques 

New activities proposed and/or planned 

Existing activities developed or modified 

Specific children— progress and/or 
problems 

Community affairs as they affect the 
school 

The student’s general effectiveness in 
the classroom 

Ways of making graduate work more 
meaningful in the elassroom situation 

Personal or emotional problems 



012345' 

012345 

0 1 2 3 4 5 

012345 

012345 

012345 

012345 

012345 

012345 

012345 



3. Was the initiative during the session taken by the 
supervisor, the student, or both of you? 



C. 



Can you give an example of a suggestion you were able to 
make that will help the student in the classroom? 



D. Were seminars, taping, or filming of lessons useful in 
this conference? How? If not, why not? 
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as observers or participants. For the first semester, they 
represent October, November, and December, whereas for the 
second semester they represent February, March, and April. 
During that period, it may be remembered, student teachers 
were instructed to make a tape recording of a lesson each 
week, and in addition they were to schedule the cameraman 
to film them or make a time-lapse sequence of their teach- 
ing. These tapes and films were available for the confer- 
ences, should the student dr supervisor decide to use them, 
but the use was not required of either of the parties be- 
yond the expectation that over a period of time each stu- 
dent was to have a healthy involvement with the feedback 
system. 

From Table One it can be seen that the standard devi- 
ations for all questions were relatively homogeneous and were 
also stable over the six month period. Only in the case of 
question seven was there any appreciable change in the stan- 
dard deviation, and that was a decline that accompanied a 
mean that diminished nearly to the vanishing point. 

Topic niunber three, teaching techniques, received, as 
might be expected, the greatest attention in the confer- 
ences, according to the students. Its mean was the hxghest 
during the / .rst month and it remained relatively high 
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throughout the year. Classroom procedures, effectiveness 
in the classroom, and discipline were the other most fre- 
quently-occurring topics, with effectiveness in the class- 
room showing steady increase through the year and being 
highest at the end (not unexpectedly, since that is when 
the evaluation of effectiveness was made formally). 

Community affairs and ways -of making graduate work 
meaningful in the classroom were the least discussed 
topics. The low position of community affairs is interes- 
ting because nearly all of the student teachers were middle 
class girls who were teaching in inner city schools for the 
first time. The schools in which they were teaching were 
the scene of much community unrest during the ye^r and were, 
in some cases, among the most-publicized cases in which 
parents demanded a greater voice in school affairs. It is 
interesting that the seminars became the center for much 
discussion of school-society relationships, whereas the 
conf erencds , devoted to the teaching of individual students, 

did not • 

Tables Two and Three show the intercorrelations of the 
nine items for the second and sixth months of the year. 
Topics three, four, and five were positively correlated, 
with topics four and five being eftpecially highly related. 
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Apparently most of the planning that went on involved the 
modification of teaching techniques, and when teaching tech- 
were discussed, it was in the context of making or 
modifying plans. Topics four and eight were also moder- 
ately correlated, indicating that discussion of the stu- 
dent’s effectiveness was associated with the development of 
new activities, no doubt to improve his effectiveness. In 
the second month, the discussion of teaching techniques was 
negatively correlated with the discussion of ways of making 
the graduate work more effective in the classroom. Appar- 
ently either the graduate study was not related to teaching 
techniques or was not seen as such. The correlation had 
disappeared by the sixth month, however. It is interesting 
to note that by the sixth month items six, seven, and eight 
are moderately correlated, indicating that there were times 
when teaching effectiveness, specific children, and community 
affiars were discussed together. Considering the low fre- 
quency of discussions of community affairs, this cluster is 
interesting. It may be that occasions when students were 
having trouble with inner city children and neighborhood 
problems occasioned the association of topics. 

Since the conferences were ostensibly built around the 
analysis of tapes and films made of the teaching 01 the 
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student, it seemed pointless to ask whether those tech- 
niques were employed. However, item in the logs read. 
"Has the practice of filming and taping lessons been related 
to the- teaching experience you have been having? If so, 
how? If not, why not?" 

The general "yesses" were disregarded, and the re- 



sponses were content -analyzed to determine whether the 
examples given supported "yes" and "no" or "no opportunity" 
responses. Table Four gives the result of that content 
analysis, which was done by two observers, working indepen- 
dently (at an agreement level of better than 90fo] . From 
Table Four it can be seen that the use of the analysis was 
at a low level during the first month (the students reported 
that they did almost no teaching during that month) and then 
went to a level of 75f> to 80^ for the remainder of the 
semester. It is interesting that right through the semester 
about a quarter of the students claimed that the language of 
analysis could not be used because they had no opportunity to 
relate it to their teaching. Since they were in classrooms 
and they were teaching, the answer to that situation has to 
be found somewhere other than lack of oppor\/unity. It 
really means that for one reason or another, they did not 
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finc^ the analysis useful or were not shown how it could be 
useful • 

The Content of the Conferences -- The View of the Supervisor 

The Log of Supervisory Conferences — Supervisor's Form 
dealt with very similar content as the student teacher's form. 
The bulk of the Log was the nine-item checklist indicating 
the extent to which the same nine topics were dealt with 
during the conferences. Table Five indicates the responses 
the supervisors gave each month in terms of means and stan- 
dard deviations. 

As in the case if the students' form, the standard de- 
viations are relatively uniform except in the case of 
topic eight, where the rising mean is accompanied by a de- 
cline in the variability. 

Topic three (teaching techniques) again was prominent 
from first to last, with topic eight (teaching effective- 
ness) rising to become the most prominent topic. Topics 
seven (Community affairs) and nine (making the graduate 
work meaningful) were least prominent. Topic six (specific 
children) declined as a topic in the view of the supervisor. 

As in the case of the student's form, item intercorre- 
lations were performed to determine the topics that were 
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associated with one another or subsumed in one another. 

Again, the intercorrelations were made for the second and 
the sixth month, and the resulting matrices are presented 
in Tables Six and Seven. 

Topic eight (community) is not associated, during 
either month with any other topic except discipline, and 
these are positively correlated in both months. Apparently 
v/hen discipline was discussed, the character of the inner 
city neighborhood tended to be associated with it, in the 
view of the supervisors. Topics four, five, and six again 
were something of a cluster, but the most high correlation 
is between teaching techniques and developing or modifying 
existing activities during the second month. Classroom 
procedures (topic one) and discipline tended to be discussed 
together, and the only topic that was positively correlated 
with teaching effectiveness was discipline, but the corre- 
lation was not high. However, the same pattern prevailed 
both months — that discipline was correlated positively 

with discussion of effectiveness. 

Hence, in the view of the supervisors, the same gen ’»rai 
order of topics was seen to occur, as seen by the students, 
but the patterns of association were some»?hat different; 
especially as the supervisors tended to believe that 
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discipline and effectiveness were discussed together. 

As in the case of the student’s form of the log, the 
supeiwisor’s form included an iten that approached the use- 
fulness of the feedback system. This item, Item 
asked the supervisor to judge the usefulness of the Feed- 
back System in the conference. Table Eight presents the 
results of the content analysis of the item for the period 

of October through January. 

The results generally are parallel with the results 
of the similar item in the student’s form, although there 
is a drop during the month of December. Also, apparently, 
if a student had a serious problem or showed much emotion- 
ality during the conference, the supervisor tended to 
avoid the use of the feedback system. This is a natural 
reaction, but one that needs some examination. Properly 
employed, one of the advantages of the feedback techniques 
should be that they compel attention to reality, which can 
provide handles for coping with emotionality on a healthy 
basis. This type of problem was not, of course, the sub- 
ject of this study, but it needs attention. 

The Students and the Supervisors’ Views Compared 



Tables Nine and Ten present a comparison of the means 
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and deviations of the student teacher’s and supervisor’s 
responses to the indication of the significance of topics 
during the conferences, and the correlation of items for 
each conference. The means are not strictly comparable, 
for the values assigned by students may not have approxi- 
mated those assigned by the supervisors. However, the 
comparison of the ratings giveii each topic can be inter- 
esting, and the correlations, indicating the extent of 
agreement between individual supervisors and students, are 

meaningful . 

The two groups, so far as the means are concerned, 
were in agreement about the topics that constituted the 
content of the conferences. The greatest discrepancy 
occurred v/lth respect to topic four, where the students 
gave less emphasis to ’’new activities proposed and planned” 
than did the supervisors. Possibly the students left the 
conferences with much less sure commitment to new course 
of action than the supervisor’s thought they had. 

During both months many of the - items were positively 
correlated. Topics two six, and seven, especially showed 
moderately high agreement betv/een the supervisors and stu- 
dents for both months. Topics one, four, and fire were 
not correlated either month, v/hile topics eight, nine, and 
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three showed low correlations one month and fairly high 
ones the other month* 

Hence, the supervisors and students in some respects 
seemed to agree about the content of the conferencas, while 
in other respects they did not agree. They agreed most when 
they had been talking ^otjlt community affairs, discipline, 
and specific children. They agreed least about the topics 
"classroom procedures" which is probably the vaguest of the 
set of items, and about the making of plans, which is 
probably a more serious area of disagreement. 

Before considering the relation between the content of 
the conferences and the use of the feedback system, we need 
to consider a special form that the supervisor completed 
after each conference and which was specifically designed 
to secure a running assessment of each student’s use of the 

feedback systems. , 

Language of Analysis in Superv isory Conference_s__ 

Table Eleven presents the Means and Standard Deviations 
for each of the six months for th? four items of the form 
entitled "Language of Analysis in Supervisory Conferences.” 

These four items are presented on page -52. 

From Table Eleven it can be seen that the means, gen- 
erally were lowest in October, when the feedback system was 



Form B-3 
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Supervisor’s Name 

Student’s Name 

Dat e 

Place 



LANGUAGE ANALYSIS IN CONjlM^ 



1. Did the student employ tapes, films or 
analysis of same in analyzing her own work. 

2. Did she use categories from one of the 
coding systems? 

3. Is the student setting goals for the 
improvement of his teaching m terms the 
analytic systems or instructional moaelo 
from the Seminars? 



4 • 



Do you find the practician systems are 
helpful in giving advice to the studen-. 



0 1 2 3 4 5 
0 1 2 3 4 5 
0 12 3 4 



0 1 2 3 4 5 



Comment or amplify if necessary* 
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being introduced, rose to their peak in November, when 
greatest efforts were being made to implement the system, 
and then levelled off for the rest of the year with none 
of the differences during the second semester reaching 

significance. 

I 

The very low means of item 1, **Did the student employ 
tapes, films, or analysis of same in analyzing her own work.^* 
are a curious finding. The question was originally included 
to enable a ”screoning-out»» of the students who were not 
using the system, so that the causes could be isolated. It 
was expected that the means would be above ■^hree, with many 
Courts and fivers. Instead, the mean is less than one^ 
indicating that, in the conferences of the second semestei^. 
the tapes and films which had been made were barely employed 
at all! let, such employment was logically essential to 
what we are told in items 2, 3, and 4» According to these 
results, many students ware using categories from the 
coding system (item 2) and actually were setting goals for 
the improvement of teaching in terms of the coding system, 
but in the conferences themselves actual analysis of tapes 
and films went on very little during the second semester. 
This is the more remarkable because the weekly analysis 
was theoretically one of the most important elements of the 



feedback system. V^e return to this topic in the discussion 
of results. 

In Tables Twelve and Thirteen are item intercorre- 
lations of the four items of the ^^Language of Analysis in 
Supervisory Conferences” for November and April, separately. 
In November, when use of the feedback system in conferences 
was apparently at its peak, the four items were highly cor- 
related, no coefficient being "^“^low .?0» 1*^ May, the drop 

in mean of item one is accompanied by a lowering of the 
correlations between item one and the other three items, 
although the latter items remain highly related. 

Apparently the supervisors and students continued, 
during the second semester, to use the analytic framework 
of the feedback system while reducing the direct analysis 
of tapes and films. The continued high relationship between 
items two, three, and four indicates that the more the stu- 
dent used the system, the more the supervisors felt the 
system was useful to the students. It is impossible to 
tell from these data whether supervisors used the system 
more with the students who responded well to it or whether 
students with whom it was more used benefitted most from 
it. Since nearly all students reported satisi action with 
the system, the probabilities favor the latter notion. 
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but we cannot be sure. 

Language of Analysis and Content of Conferences 

In order to determine whether high use of the feedback 
systems was related to the types of problems discussed in 
supervisory sessions (Was the system more useful for some 
problems than for others?) the students judged high and 
low users by their supervisors were compared as to content 
of conferences. No differences emerged. The profiles of 
high and low users on both forms of the ”logs^' were vir- 
tually identical and identical with the picture presented 
thus far. 

In a further effort to determine whether use of the 
system was related to the content of the conferences, inter- 
correlations were made between the items of the ”Use of 
Language in Supervisory Conferences” and the items of both 
forms of the ”Log of .Supervisoj.'y Conferences.” No corre- 
lation approached significance. Evidently there were no 
relations between the use of the feedback system, or of 
supei'visors * judgments about its usefulness, and the con- 
tent of the conferences. 

It had been expected that the feedback system would 

I 

be far more useful in discussions of some topics than in 
others. Apparently this was not the case. 



o 
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The Ijupervisor as a Factor 

In the course of the analysis of these data evidence 
gradually accumulated that another variable was affecting 
the use of the feedback system in the conferences — the 
supervisor# Consequently specific analyses were made of 
the "Language of ’ Analysis in Supervisory Conferences." In 
Figures One and Two the results of a comparison of means 
of items one and four is presented for the second and fifth 
months {November and April), each of whici. : > representative 
of the results for the first and second semesters respec- 
tively. The significance of differences between means was 
determined through application of the test for indepen- 
dent samples. 

In Conferences A and B the use of the analysis of tapes 
and films dropped sharply in the case of all three super- 
visors, but with conferences of supervisor A the use of the 
language in the analysis of films and tapes was never very 
high. The effective implementation of both elements of the 
feedback system by this supervisor apparently never came to 
pass in the conferences. 

From Figure Two it can be seen that supervisor C con- 
tinued to find the feedback system useful in giving advice 
to his students, whereas A and B found it much less useful 
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Figure One 

U^e of Tapes and Filnis in Conference by Super\n.sor 




— I— 

November 



April 



Supervisor A 



Supervisor B 



Supervisor C OOooOooo 



* 



B > A at .05 level. 
C > A at .05 level. 



Figure Two 

Ubefulncss of System Tsy Supervisor 
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Supervisor A 



Supervisor B 



Supervisor C b s t t c 



♦ C>B at the .05 level. 
OA at the .05 level. 
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during the second semester. Apparently supervisor C con- 
tinued to give advice in terms of* the system even while 
decreasing the direct analysis of taped and filmed episodes* 

Summary of Resu lts for Question One 

Apparently the use of the system was quite low at the 
beginning of the teacher education program, but it in- 
creased very sharply very early in the program with the 
actual peak of use being the seond month of the first 
semester. After that use continued, especially to discuss 
problems and set goals, but the actual analysis of tapes 
and films in conferences was at a low level during the 
second semester of student teaching. 

Students and supervisors were in general agreement about 
most of the content of their conferences, but the content of 
the conferences was not related to the use of the feedback 
system or perceptions of its usefulness. 

If students were emotional or upset during a confer- 
ence, the feedback system was not used. 

Evidently the feedback system came into heavy use 
after about a month of instruction in the feedback tech- 
niques despite the inexperience of the supervisors with 
respect to the system. However, the analytic techniques 
rather than direct feef^''*ack became the mode of operation 
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during the second semester. Left to their own devices, 
supervisors and students made very little use of the system 
in conferences, compared to whc^t was possible. 

It appears that one cannot count on the inherent 
attractiveness of the system to maintain a lev el of higli 
use, despite the fact that the system was use d, and be-_ 
to be useful, fairly early i n the ye^ . 



Question Two; 

”Can teacher trainees, independent 
of faculty, carry on the feedback 
and analysis sessions?" 

It will be recalled that each week groups of ten stu- 
dents with one supervisor as leader met together for a sem- 
inar, part of which was to be devoted to the use of the 
feedback system. In addition to the feedback techniques, 
supervisors were free to employ othe^ supervisory techniques 
and to build sessions around any aspects of the teaching- 
learning process. Also, it was during the seminars that 
much of the routine business of the teacher education pro- 
gram was conducted. Student teaching assignments were dxs— 
cussed, as were probl^^^ms of the communities in which student 
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teaching was done, and a wide range of topics were pr^ssible. 

Hence, in any given seminar, it was legitimate for the 
feedback system to get much or little emphasis. The whole 
seminar could be occupied with the analysis of tapes and 
films, or they could be crowded out completely. The amount 
of useage of the feedback system in the seminars probably 
reflected the overall feeling of the supervisor and his 
students about the usefulness and meaningfulness of the 
system at the moment and its applicability to the problems 

at hand. 

Furthermore, after listening to a taped episode or 
watching a filmed episode, the seminar members might dis- 
cuss teaching with or without reference to the behavior 
that had just been presented through the use of media. 

Hence, a tape might be carefully analyzed with the behavioral 
system, or it might be analyzed generally, or it might be 
disregarded and hypothetical examples of teaching discussed 
instead. It was therefore possible for a supervisor to 
employ the system, but still to prefer and actually use, 
hypothetical rather than real examples of teaching or for 
him to use verbally-transmitted rather than media-trans- 
mitted examples of teaching. 



o 
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During the semester, each supervisor absented himself 
from the seminar several times and turned the leadership 
of the seminars over to students. The preparation for 
student leadership varied widely, depending on the judgment, 
of the supervisor at the time. 

Two questions are explored here, ^^hat effects did 
the change of leadership have on the content of the semi- 
nars?^' and "’vVhat was the degree of student satisfaction 
with student-led as opposed to faculty-led seminars?” All 
seminars were tape-recorded and a content analysis was made 
of the recordings of the seminars to answer question about 
content. Several items on the ”Monthly Questionnaire for 
Supervisory Adequacy” related to the latter question. 

The Content of the Seminars 

A system for the content analysis of the verbal inter- 
action of the seminars was constructed order to compare 
the use of the feedback system with other seminar content. 

Hence, the first two categories of the system were 
developed a priori’ and dealt with the use of the two 
major aspects of the feedback system. 

They were: 

1 . Discussion of teaching with use of the system 
for the behavioral analysis of teaching. 
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2. Discussion of a filmed or taped episode of 
teaching by a seminar member. 

In addition to these categories, several other cate-- 
gories were developed inductively after the analysis of a 
number of seminars. Gradually these were combined into two 
more categories. 

3. Discussion of teaching without use of the be- 
havioral analysis of teaching or reference to a taped 
or filmed teaching episode, 

4. Discussion of administrative details of the 
teacher education program, 

A Miscellaneous” category was used but occurred with 
very low frequency and it was dropped from the analysis. 

Research assistants achieved high reliability (over 
95^ agreement) using the four-category content analysis 
system. They subsequently performed the content analysis 
of tapes of all conferences, both faculty supervisor-led 
and student-led. The unit of analysis was one utterance by 
one speaker to one listener for a period not to exceed fif- 
teen seconds. 

The content analysis system thus applied enabled the 

content of the seminars to be separated into commxmications 

• 

involving the elements of the feedback system and 
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ootrimunication which did not involve those elements. It was 
particularly desired to track the amount of use of the feed- 
back system throughout the year of the teacher education 
program and to see whether the system was used more or less 
when the leadership of the seminar was changed. 

The seminars are designated by supervisor and hence 
will be referred to as Seminars A, B, and C. The convent 
of the seminars varied by supervisor and as a consequence, 
the data were analyzed and are presented separately for each 

seminar. 

The Content of Su p*>T^vifior-»led Seminary 

Table Fourteen presents the frequency and percentage 
of the four categories for the first semester by supervisor. 
Regarding first the totals for all supervisors, it appears 
that about one third of the communications within their 
seminars were devoted to administrative routine, thirty six 
and one-half percent involved discussions of teaching when 
the feedback system was not employed, and about thirty per- 
cent involved discussion of teaching when the feedback 
system was employed. 

The amount of communication given to administrative 
detail seems large for seminars which are ostensibly held 
for instructional purp-'ses. {In Seminar A, the total was 









CQ 

U 

cd 

c: a 

(D *H 
0) 6 
■P 0) 
Jr< CO 

O <H 

pC4 O 

0) P 
H Cj 
P Q) 
(d P 
B d 
o 
o 



u 

o 

(0 

•H 



u 
0) 
p 
(Tr 

d> 

<P CO 

d p 

CO CO 

r>»*H 
rO ptl 







H 






u\ 


rH 








i 




• 


• 


• 








Ch 




H 


vO 






f~{ 








cv 




r*\ 




cd 
■ ^ 
















4-* 

o 




r>- 




VO 


trs 


lA 


CA 


H 


fn 


H 




H 


to 


to 


o 






u^ 




CV2 


o 


to 












rH 


CVJ 


H 


»A 














CJv 




O 








vO 


to 


H 








• 




* 


• 


• 








C^ 




rH 


o 


O 




(d 




H 




fH 


-t 


CA 




d 
















•fH 
















g 




vO 




irv 


OV 


H}- 


•4- 


0> 




cr\ 




CV2 


to 


to 


«A 


CO 








csi 




lA ' 


CJv 
• H 


PQ 




H 




O 


c^ 


H 








• 




• 


• 


* 












ir\ 




l>- 




(d 








cf\ 


cf\ 


CV2 




d 
















•H 
















g 




H 




r- 


rH 


CVi 


rH 


0) 


tx« 


<0 




to 


\0 


rr\ 


vO 


CO 








vO 


vO 


uv 


<7v 

rH 


< 




u\ 


■ 


to 


H 


lA 








• 




• 


• 


• 




u 




cr\ 




vO 


»A 


cvi 




(d 








H 




Ht 




d 

- —I 
















*Ti 

g 




O 






UN 


OV 


to 


Q> 




O 




O 


<n 


vO 


o 


CO 


% 


H 






vO 


l> 


CO 

H 




;d 




x: 


o 








P 




p 


a 








•H 




•H 










3c 






1 


0) 

> 






bo 


B 


bO (0 


bO 6 


•H 






d 


0) 


d £ 


d <d 


P 






•rl 


p 


•H rH 


«H P 


0) cd 






xi 


(0 


XI »H 


XJ to 


XI ^4 






O 


>» 


O 


o >» 


O P 






(d 


CO 


Cd 


cd CO 


cd to 






0) 




<U TJ 


0> 


0) ‘(H 






en 


o 


E-« d 


Eh M 


eh d 








•H 


cd 


O 


*fH 






C»H 


p 




cd 


«M e 






o 


s 


0 to 


O X 


o '3 








1 — 1 


0) 


Tl 








d 


cd 


d cu 


d Q> 


d 






0 


d 


0 cd 


O 0) 


o d 






H *H 


c 


CvJ ‘iH Eh 


c<> ‘fH (x( 


•^hiH O 






(0 




to 


CO 


to *rH to 






S to 




S to «H 


p* CO «H 


>» to p H 






d 


0 


d o 


& d 0 


j-i d Cd ‘H 






c< o 




o o 


0 o 


o o o cd 






bd (0 


d> 


bO CO 0) 


bO (0 0 


bO CO d P 


H 




0) *H 


CO 


d> H to 


0) *H to 


0) *H *d 0) 


Cd 




P Q 


S3 


p Q :=> 


p p d> 


P P W P 


p 




(d 




cd 


cd 


cd 


0 




o 




o 


o 


o 


■ Eh 



99 »s«i 



o 

ERIC 



Chi Square = 5^9.745 {p.<.005) 



actually 42.5 percent.) 

The distribution of communications within the seminars 
were quite different in the amount which involved the use 
of analysis (17.3 percent in Seminar C against 5*5 percent 
and 4.1 percent in Seminars A and B). Communications refer- 
ring to tapes and films also varied widely (35*0 percent 
in Seminar B and l6.B and 11.6 percent for the others). A 
chi square test enables the rejection of the hypothesis 
that the proportions are the same with better than the 
.005 level of significance. 

The distributions for the seminars of each supervisor 
changed during the semester with respect to the use of the 
feedback system. Figure Three shows the pattern for October, 
November, and December, when the students were in the 
schools and tapes and films were available during the first 
semester, and shows the second semester figures as well. 

Supervisor ”A»^ did not employ the feedback system at 
all during the month of October, but it was included in 
over twenty-five percent of the commiuiications of his 
seminars during the other two months. The seminars of the 
other two supervisors reached, a peak of about 50^ in Novem- 
.ber, then the one who began with the highest proportion of 
usage in October ( 3 ^%) dropped off to ten percent in 



Figure Three 

Seedback-Related Consnunicatioris for Each Supervisor’s Seminars by Month 
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December, while the seminars of supervisor B dropped only 
to thirty eight percent. 

Second semester communications involving the feedback 
system dropped off compared to the first semester and vir- 
tually disappeared by April. 

There is some similarity, then, in the amount of use 
of the feedback system between seminars and the conferences 
discussed during the last semester, with low use at first, 
and a sharp rise in the second month. 

In Table Fifteen the content of Seminars "B,” 

and are compared for the three months. Chi square tests 
indicate that we can reject the hypothesis and that the 
proportions were the same, in all the months, for any of the 

seminars. 

Content of Seminars Under Student Leaders 

Since the three seminars displa^^ed different patterns 
of use of the elements of the feedback system, the com- 
parison of the content of each seminar under faculty and 
student leadership will be made separately. 

Tables Sixteen, Seventeen, and Eighteen present a con- 
tent analysis for each of the three seminar groups, for 
the sessions in which there was student leadership and 
three sessions in which there was faculty leadership. The 
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Table Fifteen 

Feedback and Non-Feedback-Related 
Communications for Each Seminar 
Through the First Semester 



Month 


Feedback-Related 

Communication 


Non-Feedback - 
Related Communication 


Total 


Seminar A 








October 


0 


424 


424 


November 


81 


379 


460 


December 


164 


25s 


422 


Total 


245 


1061 


1306 


Chi Square = 


210.209 (p.^;.005) 






Seminar B 








October 


194 


534 


728 


November 


425 


3^7 


812 


December 


31b 


302 


612 


Total 


929 


1223 


2152 


Chi Square = 


122.800 (p,< .005) 






Seminar C 








October 


210 


442 


652 


November 


262 


421 


683 


December 


97 


803 


900 


Total 


569 


1666 


2235 


Chi Square ~ 


177.774 (p.<.005) 




. 
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Table Sixteen 

Content Analysis of Seminar A 
Under Faculty and Student Leadership 



Type of 
Leadership 


Feedback-Related 

Communication 


Related 


Communication 


Total 


Faculty 


280 




302 


(51.951). 


5^2 


Student 


233 


(42.1^) 


320 


(57.8?5) 


553 


Total 


513 




622 




1135 


Chi Square 


4,083 


(p.4 .05) 
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Table Seventeen 
Content Analysis of Seminar B 
Under Faculty and Student Leadership 



Type of 
Leadership 


Feedback-Related 

Communication 


Non-Feedback - 
Related Communication 


Total 


Faculty 


419 


(49. li^) 


435 


(50.99S) 


854 


Student 


460 


(64.7f») 


251 


( 35 . 3 ^) 


711 


Total 


879 




6^6 




1565 



Chi Square = 3^*520 <p.<.005) 




mmn 
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Table Eighteen 

Content Analysis of Seminar C 
Under Faculty and Student Leadership 



Type of 
Leadership 



Feedback-Related 
nommunication 



Non-Feedback - 
poiflt.ffd Communication 



Total 



Faculty 
Student 

Total 

Chi Square == 225*403 



(37.3/») 


480 


(6.7^) 


791 




1271 


(p. <1 .005) 





(62.7/») 


766 


{ 93 . 3 %) 


848 




1614 



57 

343 



\ 



[ 



[ 

i 




I 
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supervisor and student-led sessions were close together in 
time, to minimize differences that m .ght have been caused 
by the tendency of seminar content to change during the 

semester. 

In Seminar A showed a similar proportion of feedback- 
related behavior occurred under student and faculty leader- 
ship, but the difference in proportions was great enough to 
be significant at the .05 level. In Seminar B student-led 
sessions showed much more (fifteen percent) feedback system 
communications and the difference in proportions was signi- 
ficant at the .005 level. In Seminar C the feedback-related 
behavior almost disappeared under student leadership. In- 
terestingly enough, discussion of administration, especially 
. of cooperating teacher relations, actually increased under 
student leadership of seminar C, and totalled 38 percent for 
the semester. The students frequently seemed, while analyzing 
tapes, to drift away from the topic of teaching and begin to 
discuss their program, their relations with schools, and the 

obligations of cooperating teachers. 

Apparently either the type of leadership given by fac- 
ulty or the student composition of the seminar groups 
resulted in sharply different effects when students took 
over the seminars. It is interesting that in Seminar G, 
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where feedback-related behavior almost disappeared under 
student leaders, the proportion of feedback-related be- 
havior was lower under faculty leadership than it was at 
that point in the semester under faculty leadership. Also, 
feedback-related communication was low in all three of 
Seminar C»s student-J^led sessions.- A close examination of 
the tape recordings of those sessions revealed that in 
those sessions little use was made of tapes or films of 
student lessons. 

Student vSatisfaction with the Student-Led Seminars 

At the end of the semester the ^’Questionnaire on 
Seminars” was administered to all the students. This in- 
strument included a number of ’:cjuestions about whether 
students were comfortable using the feedback techniques. 

The substance of the results was that about twenty-five 
of the students felt increasing comfort with the techniques, 
and believed they had growing competence in their use. 

Also, the questionnaire included a checklist regarding 
satisfaction with various dimensions of the faculty and 
student-led sessions. 

As Table Nineteen, the checklist is presented with 
the frequencies tabulated for each cell. Apparently the 
checklist was not clear to the students, so the frequencies 
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Form D - First Semester 
Student’s Form 
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QUESTIONNAIRE ON SEMINARS 

Name ^Date 

Cooperating Teacher^ — 

A. Did the Se'^inars help you look at your teaching more objectively? 
If so, specify how. 



B. Dxd they add to your rapport with your cooperating teacher? 

t 

with your college supervisor? 



C. Did you become competent to use the analyses of teaching 
techniques that were presented? Explain. 



D. Did you grow more comfortable with this technique as the 
semester advanced? 



o 
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£. Your college supervisor was present at some of the Film Feedback 
sessions. .Would you check the following categories to indicate 
how these sessions compared to those where he was not present? 



Sessions with Supervisor present Sessions with Cooperating Teachers 
; only 



More 


Same 


Loss 


Categories 


More 


Same 


Less 








Comfortable 














Helpful 














Vigorous 














Concrete 














Extensive 














Theoretical 














Related to 
Classroom 














Related to 
Program 









F. Can you give a concrete example of the difference between the 

sessions where your supervisor was present and where he was absent? 
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Table Nineteen 

Student Satisfaction with Faculty 
and Student Leadership of Seminars 
by Frequency of Response 



E. Your college supervisor was present at some of the Film Feedback 
sessions. V/ould you check the following, categories to indicate 
how these sessions compared to those where he was not present? 



Sessions with Supervisor 
present 


' 


Sessions with Cooperating 
Teachers only 


More 


Same 


Less 


Categories 


More 


Same 


Less 


2 


16 




Comfortable 




10 




10 


8 




Helpful 


3 


3 ■ 


4 


10 


8 




Vigorous 


1 


6 


._2 


9 


8 


1 


Concrete 


4 


4 


2 


10 


5 


1 


Extensive 


2 


2 


4 


10 


6 


2 


Theoretical 


2 


6 


2 


8 


8 


2 


Related to 
Classroom 


3 


6 


1 


13 


5 




Related to' 
Program 


1 


5 


jt 


78 


64 


6 


Total 


16 


42 


20 
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of the responses related to faculty-led conferences do not 
correspond to those for the student-led conferences, which 
should be the case. Hence, no statistical analysis was 
attempted. Inspection, however, leaves the impression that 
the faculty-led seminars were more highly valued. 

Only 20^ of the checks for student-led discussions 
were indications of %ore” whereas over 50% of the checks 
for faculty-led sessions were %ore.” Fewer than 5% of the 
checks for faculty-led sessions were in the ’’less” column, 
whereas 25% of the checks for student-led discussions were 
placed in the ’’less” column. 

The last item of the ’’Questionnaire on Seminars” asked 
whether students could give a concrete examples, of the dif- 
ferences between the two types of sessions. Seven students 
remarked that there were no differences. Seven felt that 
faculty-led sessions were ’’more relevant.” Four (all from 
Seminar C) remarked that teaching styles were more effectively 
discussed when the faculty member was present. Four students 
stated that the discussion wandered when students were 
leaders. Three favored student-led seminars because they 

t 

dealt more directly with student problems. 

The results are somewhat mixed. Evidently feedback 
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content can be used by student-led groups -- students can 
help one another analyze teaching. However, one group did 
not continue analyzing teaching when the faculty member was 
not present and some students expressed dissatisfaction with 
student-led seminars. Clearly careful training is necess- 
ary if the feedback system is to include prominent roles, 
but the development of such roles appears to be feasible. 



Question Three: 

”To what extent can cooperating teachers 
from the public schools substitute for 
college faculty in providing feedback to 
student teachers?’^ 

During the second, or Spring semester, cooperating 
teachers from local schools were attached to each of the 
seminars. They worked with the faculty until they indi- 
cated that they were comfortable with the* feedback system. 
Then they provided leadership for several of the seminar 
sessions (at least four sessions for each seminar group.) 
Again, an analysis was made of tape recordings of the 
seminars so that the use of the feedback techniques could’ 
be gauged from the verbal interaction within the sessions. 
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Content of Faculty-Led Seminars During Second Semester 

Table Twenty shows the results of the content analysis 
for the faculty-led seminars during the entire second 
semester. 

Again, the proportions of communication classified 
into the four general categories differed from Seminar 
group to Seminar group. In Seminar A over of the com- 
munication still involved administrative details, with only 
slightly over 15?J being involved with the feedback systems. 
In Seminar C, use of the feedback system was indicated by 
only ^ of the communications, while two-thirds of the 
interaction was discussions of teaching which did not in- 
volve use of the feedback system. 

The results indicate that in the seminars, which pre- 
sumably were to be structured around feedback techniques, 
actually very little verbal interaction was really feedback 
related. Given the choice, supervisors and students evi- 
dently preferred or were more able to talk about adminis- 
trative manners or about teaching! but without us ing the 
feedback system . 

Further, the amount of seminar communication that was 
devoted to feedback dropped off in the course of the 
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semester. Figure Four indicates the percentages of com- 
munication devoted to the two elements of the feedback sys- 



tem during each of the three months of the semester. The 
use )f the behavioral analysis almost disappeared during 

I 

the second semester, dropping to one-tenth of one percent 
during April. The use of tapes and films continued, but at 



a much lower level than during the first semester. Also, 
during February, the month of highest use of the feedback 
system, an external force operated on the seminars. All 
students made two television tapes during that period and 
the tapes, with an operator for the tape machine, were 
"made availabl.e" to the seminars. With tapes, machine, and 

I 

operator so prominent in the situation, the use of feedback 
was probably given an artificial boost. 

Cooperating Teacher Leadership: The C ontent of the Semin a, r _s 

In Table Twenty-one, Two, and Three, are presented the 
content analysis of three sessions of each Seminar when 



cooperating teachers served as leaders, compared with three 
faculty-led sessions closest in time to the teacher-led 



The use of the language for analyzing teaching vjas 
uniformly low in both types of leadei-ship. In Seminar C, 
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Figure Four 

Use of Elements of Feedback System 
Under Faculty Leadership Luring 
the Second Semester 




Language of Analysis 







Tapes - Films 
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Table Twenty- Two 
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not even a single communication was classified as a use 
of the behavioral analysis. In Seminar A, however, both, 
faculty and student-led use of films and tapes was about 
20/o and in Seminar C about 10% of the interaction was direct 

discussion of tapes and films. 

Although in all three seminars the proportions are 

significantly different, much of the difference can be 
accounted for by attention to administrative detail when 
the faculty member was the leader. (Over kO% In Seminar A, 
25% in Seminar B, and nearly 25% -n Seminar C.) When Cate- 
gory 4 is eliminated from the analysis, the differences in 
proportions in Seminars A and B disappears. In Seminar C 
the difference is that in poop6£ating..teacher-led sessions 
a much higher proportion of communication was related to 
the analysis of films and tapes. Table Twenty-Four compares 
the three seminars under the two leadership conditions with 
the administrative category removed. The most interesting 
finding in the data is that the more the faculty-led 
sessions employed the tapes and films, the more the cooper- 
at.inir teacher-led sessions employed those devices. Can we 

V., ^ ^ , 

speculate that if the faculty had used the behavioral anal- 
ysis more, then the cooperating teachers would have followed 
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suit? Or are the students the variable? 

In any event, the use of feedback by the sessions 
chaired by teachers was very close to the use by faculty. 
Student Satisfaction with Teacher Leadership 

Again at the end of the semester the "Questionnaire on 
Seminars" was administered to the students. The first 
questions asked if they were becoming more competent and 
comfortable with the feedback system and again eighty 
percent of the students said they were and about five 
students {l6%) said they definitely were not . 

With respect to their opinion of the different types 
of leadership in the seminars, the students were presented 
with the same checklist used to compare leadership patterns 
during the first semester. 

Table Twenty-Five contains the results. Again there 
was some confusion with respect to the use of the checklist 
and again statistical analysis is not possible, but the im- 
pression again is that there was some preference for faculty 
led seminars. However, looking at the individual question- 
naires, only four students definitely preferred the faculty 

leadership, and those four accounted for most of the dif- 

1 

t 

ferences that can be seen in Table Twenty-Five. 
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Table Twentjtt-Five 
Student Satisfaction with Faculty 
and Student Leadership of Seminars 
by Frequency of Response 



E. Your college supervisor was present at some of the Film Feedback 
sessions. Would you check the following categories to indicate 
how these sessions compared to those where he was not present? 



Sessions with Supervisor 
uresent 




Sessions with Cooperating 
Teachers only 


More 


Same 


Less 


Categories 


More 


Same 


Less 


1 


25 


0 


Comfortable 


1 


22 


1 


15 


12 


0 


Helofia 


3 


16 


6 


9 


. l6 


1 


Vigorous 


__i 


15 


4 


9 ' 


14 


1 


• ^ 

Concrete 


6 


U-15 


1 


12 


14 


0 


Extensive 


2 


16 


5 


11 


14 


1 


Theoretical 


3 


14 


6 


3 


16 


4 


Related to 
Classroom 


7 _ 


16 


1 


3 


15 


0 


Related to 
Program 


2 


lU 




6S 


126 


1 - 


Total 


27 


128 


29 
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Reasons given for preferring one leadership over 
another followed no particular pattern. The most fre- 
quent comment was that sessions led by cooperating 
teachers were ”more realistic.” 

It is possible that were roles of both stvdent 
leaders and teacher leaders legitimized more fully that 
there would have been different results. 

To summarize, the amount of use of feedback system 
elements when cooperating teacher assumed leadership of 
th.. seminars closely followed the patterns of the super- 
vispry-led sessions. The chief difference in leadership 
pattern was in the area of ’’administrative detail,” where 
naturally the faculty member would be more involved than 

I 

the teacher. Students did not seem to prefer cooperating 
teacher leadership, but that pattern is mixed. The 

I 

I ■; 

students gave few concrete examples that clearly favor 
faculty leadership, and some seemed to value the practical 
leadership of the cooperating teacher. 

”How Much ’’live” Classroom Visitation 
of Student Teachers is Required in Addition 
to the Analysis and Feedback Sessions?” 

In a practical sense, the approach to this question 
was to reduce the amount of vclassroom supervision by 
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faculty members and to see if there were any observable 
effects. This strategy did not permit a full answer to 
the question "how much is needed" but rather permits some 
judgment about whether "normal" supervision can be re- 
duced drastically without undesirable effects. Through 
subsequent studies optimal systems may be constructed - 
probably involving the use of flexible supervision 
psitt/sms • 

Normal supervision in the Teachers College program 
required each supervisor to visit the student teacher in 
his classroom not less than once each week. This pattern 
was followed for half of the students in supervisory 
groups "A," "B," and "C." This half will be referred to 
as the Weekly Visitation Group. The second group of the 
students were visited just half as often, and we will 
refer to them as the Bi-Weekly Visitation Group. Students 
were not told that there was to be any variation in the 
amounts of visits they were to receive. Supervisors were 
instructed to behave toward all students as if their indi- 
vidual pattern was normal and tailored to their needs. 

Students were permitted to request additional confer- 
ences with faculty members in addition to the regularly- 
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scheduled one. This practice involved a kind of safety 
device” for the students whose supervision was reduced, 
because they could ask for more help as they needed it. 

It also seemed that the amount of requests for help and 
the type of help asked for would yield a solid index of 
whether the students felt they were getting enough super- 
visory help. If the students in the Bi-Weekly visitation 
group were being deprived of sufficient help, for example, 
then the effects of that deprivatio:^ might be seen in 
more cries for help. 

Hence, each faculty supervisor announced to his 
group that he was available on an ”on call” basis. The 
principal investigator prepared ”on call” reports which 
each supervisor was to complete each time a student asked 
for help. These questionnaires were designed to identify 
the reason for the ”on call” contact and the type of 
• action taken. 

The ”0y-Call” Contact Between Faculty and Students 
The effort to use ”on call” contact as an index of 
felt need for supervision was a failure. The thirty stu- 
dents init lated only eleven contacts with their super- 
visors during the entire semester, and two students 
accounted for six of the contacts. Only once did a 
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supervisor report that he initiated contact with the 
student. Eight of the ”on call” contacts were with stu- 
dents who were being supervised weekly. The small amount 
of demand contact, however, renders worthless any attempt 
to compare the two groups on that basis. Either student 
need for supervision did not manifest itself through ini- 
tiation of contact with the supervisors or both amounts 
of supervision were well above the level which would give 
use to the need. (Possibly of course, students simply 
wanted to minimize contact with their supervisors for com- 
pletely different reasons than those being investigated 
here. ) 

Student Opinion about Supervisory Adequacy 

Each month during the year each student completed a 
questionnaire in which he was to indicate the kind of pro- 
gress he v/as making in his student teaching and comment on 
the adequacy of his supervision. (The "Monthly Question- 
naire for Supervisory Adequacy.”) During the months on 
which the amount of supervision varied the responses to 
the questionnaire were tabulated and analyzed. 

Again the criterion measure displayed too little 
variability to enable clear judgment. All but two of the 
students consistently reported that they were receiving 
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adequate supervision. Students did not report any need 
for help that revealed a pattern. Evidently all the 
students were quite well satisfied with the supervision 
they were receiving. 

Supervisors completed the same questionnaires with 
exactly the same result. On all relevant items satis- 
faction with supervision was expressed. 

Apparently, then, reducing the classroom visitation 
by half was not sufficient to increase on-call reports or 
to decrease student or supervisor satisfaction. 

In a further attempt to determine the effects of 
varying supervision, the individual items on the ^^Monthly 
Questionnaire” were analyzed. Table Twenty-Six presents 
the results for all subjects on both forms. It is inter- 
esting to note that the supervisor’s means were higher 
than the student’s means on all items pertaining to 
growth and were equal or lower on all items pertaining to 
difficulty in student teaching. In other words, the stu- 
dents appeared to be harder on themselves than the super- 
visors were, rating progress lower and difficulty higher. 
In addition, it is interesting to note that only two 
correlations were positive. On no item where growth was 
concerned did the supervisor and student’s ratings show a 
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positiv© corrolat/ion. With respect to difrioulties en~ 
countered, only two correlations were positive, those per- 
taining to discipline and personal or emotional problems- 

The Weekly and Bi Weekly groups are compared in 
Table Twenty Seven in terms of the means and standard 
deviations of the monthly questionnaire items, student’s 
form and supervisor’s form, for the last month of student 

teaching. 

The results indicate that the means were nearly 
identical for all items on both forms of the question- 
naire . 

Evidently, frequency of supervision did not affect 
the growth made or difficulties' encountered by the stu- 
dent teachers. It must be remembered, also, that the stu- 
dents were not aware that supervision was being varied 
systematically (although they were no doubt aware that 
all was not equivalent on the program) but the supervisors 
definitely were aware that they were se'^ing some students 
twice as often as others. Aware or not, they saw no 
differences in progress or problems. 
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Discussion 

The object of the study is to contribute information 
which can be used in the development of integrated feed- 
back systems for teacher education* Integrated systems 
combine the behavioral analysis of teaching with tape and 
film reproduction of teaching episodes to assist the novice 
teacher to comprehend what he does as a teacher and to set 
goals and monitor his progress toward those goals* 

The strategy of this study was to implement an in- 
tegrated feedback sy!!ti5m in a teacher education program 
which had not prev’wi-sly had one, and to observe the be- 
havior of staff and students who were learning to use the 
system* Identifying the tasks they could do easily and the 
difficulties they encountered should increase our under-, 
standing about personnel deployment and training over a 

feedback system. ^ 

The results that have been presented thus far need 
to be interpreted in the context of an important condition 
that was not within the scope of the study as it was de- 
signed* That condition is that the faculty supervisors 
were inexperienced in feedback techniques and remained 

I • 

uncomfortable with the system to a great extent throughout 



the year . Although only three faculty members were 



involved — hardly a representative national sample of 
teacher educators — the principal investigator is now 
convinced of what he should have known previously, that 
a feedback system should not be instituted unless it is 
accompanied by intensive staff training and specification 
of roles. The effectiveness of the feedback system 
studied in the present investigation were greatly con- 
ditioned by the inexperience of the faculty, their inse- 
curity with the procedures, and their consequent varying 
morale. ♦ 

Inservice training for college faculty members is 
a rarity. College faculty are not removed, however, from 
the need to improve their competence, and the case in 
point illustrated the need grossly. Yet these faculty 
members were the carefully selected staff of the teacher 
education program of a major university. They were pre- 
paring for positions of leadership in other programs. 
Theoretically they should be well above the average in 
ability to teach themselves. Yet everything reported 
herein is conditioned by the fact that they did not receive 
enough training for the t&i :s they were called on to 
master. (The fault was not theirs.) This observation, 
informal and accidental as it is, is probably the most 
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important finding of the study. 

The rhetoric of their troubles was staggering. The 
faculty reported openly that they were uncomfortable at 
first when they analyzed tapes and films with students. 

The behavioral analysis of teaching seemed awkward and it 
was a long time before they learned to supplement it to 
develop a rounded strategy to use with their students. 

They only slowly came to see how to use time-lapse se- 
quences for feedback. They disliked persuading students 
to submit to filming. All of these practices are so 
routine to the principal investigator that he utterly 
failed to anticipate that they would be so troublesome 
to learn. 

However, the feedback system did go into effect and 
all elements were in use thrcughout the year. The faculty 
struggled through, and their troubled state enables us to 
examine staff utilization problems more sharply, probably, 
than if they had been highly skilled persons, dedicated to 
the development and improvement of feedback systems . 

It seems safe to conclude that students can begin to 
apply the analysis of teaching to films and tapes of their 
own teaching after only a few hours of instruction in the 
analysis of teaching. However, they need skilled 
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assistance if they are to set realistic goals for them- 
selves and monitor their own progress. The fact that some 
students were uncomfortable with the system throughout the 
year suggests the conclusion that differential treatment 
should be accorded these students. It is possible that 
they may need special private sessions with very skilled 
and supportive instructors. It is interesting that the 
analysis of films dropped off in the conferences but many 
students continued to set goals in terms of the behavioral 
system. Evidently the framework of analysis remained use- 
ful and provided a language for goal setting. Although we 
cannot conclude for certain that the supeirisor was a 
powerful variable, because the students were not randomly 
assigned to seminar groups, it appears very likely that he 
was an important factor, especially because the supervisors 
and students were reassigned at the end of the second 
semester and the supervisor’s ’’patterns” seemed to persist. 
This reinforces the conclusion that the analysis of teach- 
ing can be carried on quite early in a program provided 

the instructors are skilled. 

• students apparently were quite able to carry on the 
analysis of one another’s teaching in seminars, although 
they tended to prefer faculty leadership. No strong 
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dissatisfaction with student leadership occurred, however, 
and it appears that integrated feedback systems could well 
provide for student - student analysis of teaching roles, 
/igain, the supervisor seemed to be a powerful variable, 
although we are not sure of this. It seems warranted 
that we. conclude that students feedback roles can be 
included — with faculty roles — in integrated systems 
provided proper training is given by skilled faculty. 

Cooperating teachers also were able to provide 
leadership, again with some reservations by students, 
and the supervisor’s pattern of work seemed to influence 
the cooperatLng teacher’s patterns greatly. The training 
of the cooperating teacher should probably be done 
systematically and not left to all faculty. However, 
there is much promise in including teachers in feedback 
roles because it plants the feedback system firmly in the 
public schools and probably would have a unifying effect 

on the goals of teachers and faculty. 

It is notable that a huge percentage of communication 

was devoted to administrative matters when the faculty 
members were present, whereas under student and teacher 
leadership the seminars examined teaching almost exclu- 
sively, whether the feedback system was used or not. b’e 
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can wonder how much time is taken with administrative de- 
tail in many seminars on teaching in other programs. It 
seemed to the research assistants who performed the con- 
tent analysis that the faculty - led seminars were in a 
state of constant interruption by students asking ques- 
tions like, ”Do we go to the schools on Columbus Day?” 

"If we were in upper grade last month do we go to a lower 
grade next month?" and so on. Definitely organization 
needs to be accomplished. However, student and teacher - 
led sessions often seemed to the research assistants to 
get down to business and stay there because without the 
faculty member present, there was no one to whom to ask 
the administrative question. 

Despite the limitations of the date — the paucity of 
"on call" reports especially — it seems clear that we 
four.d no sign of harm when classroom visits by supervisors 
were reduced by half. While we have no way of telling 
what an irreducible minimum should be, the way seems clear 



to the development of integrated feedback and supervisory 
systems that rely on a combination of teacher roles, stu- 
dent roles, and faculty roles and in which on-the-spot 
visitation of student teachers in the classroom is only a 
part of the supervisory process, rather than its backbone. 
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as in the past. 

The unexpected finding that supervisors and students 
did not agree on the areas in which students were growing 
or the areas in which they were having difficulty (except 
for disciplinary problems!) warrants attention. Surely 
it seems that a feedback system could be constructed so 
as to increase supervisor and student agreement. 

Certainly it is hard to explain how students and 
supervisors can be together for an entire year, examining 
films and tapes of teaching, discussing teaching in be- 
havioral terms, and still fail to agree on areas of pro- 
gress and difficulty other than discipline! We are temp- 
ted to speculate that the entire supervisory process - 
feedback system and all — was seriously flawed. There 
needs to be careful study of communication about teaching 
among the personnel engaged in the various roles in an 
integrated feedback system. Simple reliability in using a 
behavioral - analytic system is not sufficient to produce 
close communication on all phases of supervision. 
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Vie can only speculate about whether student -faculty 
agreement oa areas of grovrth and difficulty would have 
been greater if the use of the feedback system had been 
maintained at a high level throughout the year. It is 
necessary, before we can answer that question, to observe 
the effects of a more fully implemented system than we were 



able to bring about here. 
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Recommendations 

The recommendations in this ..section reach somewhat 
beyond the data and, in addition, draw on a more general 
experience with integrated feedback experience. They 
also draw to a limited extent on a developmental study of 
the teaching behavior of the student teachers who were the 
subjects of this study. The developmental study, which 
paralleled the present investigation, resulted in some 
measures of the effectiveness of the feedback system which 
was the focus of the present study. 

The results of the investigation of staff behavior 
reported herein v/ere mixed and were severely conditioned by 
the inexperience of the faculty who implemented the system. 
However, some consistent patterns emerged and several recom- 
mendations can be made with respect to the development and 
implementation of feedback systems for teacher education. 

The most important recommendation has been stated in 
the previous section. It is that the implementation of 
fe edback systems require extensive staff training and sup- 
port and, at least in the initial yea?rs, a rather definite 
specification of faculty roles. Staff need to know how to 
help students analyze their teaching, set goals, and monitor 
progress. Staff also need specific advice on how to train 
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students to provide feedback to one another. The fact 
that student use of the system varied with faculty super- 
visor suggests that faculty behavior should be closely 
studied to determine how they can best behave to optimize 
student use of the system. 

Second, because the behavior of students, student 
leaders, teacher leaders, and the content of feedback 
sessions generally seems to be at least a partial function 
of individual differences in faculty, then faculty need to 
be taught to recognize their own effects and to modulate 
them in behalf of the students. 

Third, the tendency of faculty supervisors to devote 
a substantial portion of group feedback seminars to admin- 
istrative trivia suggests that the administration of any 
feedback system should be conducted so as to minimize the 
necessity to deal so continually with organizational matters. 

Fourth, it appears that prominent faculty and teacher 
roles can be successfully developed in feedback systems. 

Fifth, the absence of effects when supervision in the 
classroom was reduced suggests that careful investigations 
should be undertaken to determine optimal supervision when 
feedback systems are employed. 

The lack of agreement between faculty and students 
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on the areas of progress in learning to teach and the areas 
of difficulty suggests that the processes by which students 
and faculty learn to analyze teaching need to be scruti- 
nized very carefully. It seems necessary to include within 
feedback systems methods for continually monitoring and im- 
proving the reliability of all parties in the analysis of 
teaching and for providing help in transferring behavioral 
analyses to other more general judgments about teaching. 

Despite initial faculty discomfort in the' use of the 
feedback system, much use of the system was attained by 
the second month and it appears that the self-analysis of 
teaching can begin after relatively short periods of train- 
ing. However, the clear tendency to use more traditionally 
based discussions of teaching as the year went on suggests 
that if a feedback system is to be maintained and improved, 
it needs to be constantly tended. Especially during the 
latter part of the year, faculty frequently observed a 
film of a student and then, after perfunctory discussion of 
the film, discussed teaching techniques without reference 
to the filmed episode. Faculty and students need help in 
rejuvenating their use of feedback techniques, not so they 
will use them exclusively, but so they do not, in their 
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discur:.nions of teaching, shy away from the relatively 
strong reality of tapes and films, and take refuge in 
hypothetical discussions. 

ilowever, it seems quite possible to prepare faculty, 
students, and cooperating teachers to 'If ill feedback 
roles that are integrated with ”live^^ visitations and 
supervision to create a solid, integrated system. The 
results of this investigation, however, point to the 
nece^ 3 sity of careful role definition and training for roles 
especially with respect to faculty deployment. 
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Siammary 

An integrated feedback system which was designed to enable 
student teachers to analyze their teaching, set goals for improve- 
ment, and monitor their own progress was instituted in the Teachers 
College, Columbia University, Teacher Education Bfogram. The central 
elements of the system were the use of a system for the b^avioral 
analysis of teaching and the use of regular films and audio and 
television tapes of teaching by the student teachers. Faculty be- 
havior was analyzed, and students and cooperating teachers assumed 
feedback roles, with the effects analyzed. In -addition, classroom 
visitation of student teachers was varied to determine the effects 
of such a reduction when a feedback system is in use. 

Content analyses of feedback sessions and questionnaires given 
to faculty and students were the sources of the data. 

It was concluded that supervisors need extensive training for 
feedback roles. Students and cooperating teachers led supervisory 
sessions without apparent negative effects on the content of the 
feedback sessions, but the individual supervisor was an important 
factor in the content of the seminars under all forms of leadership. 
Evidently the use of the feedback system can profitably begin early 
but it needs careful monitoring. There is a tendency for supervisors 
to use hypothetical discusi^ions of teaching in lieu of discussions 
of filmed and taped teachiiig episodes. Varied amounts of classroom 

supervisi'^n produced no ill effects. 

Pronounced differences between supervisors and students with 
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respect to the evaluation of teaching suggest that the relatively 
high reliability of b^avioral feedback may not be transferred to 

more general evaluations of teaching. 

It is recommended that integratea feedback systems include 
prominent feedback roles for students and for cooperating teachers, 
but they need training to fulfill those roles and students preferred 
faculty leadership, 'which indicates that expectations and roles need 
to be carefully defined. 
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